PATENT ABSTRACTS OF JAPAN 

(1 1 )Publication number : 2000-022929 
(43)Date of publication of application : 21.01.2000 



(51)IntCI. 



H04N 1/387 
G03B 27/52 
G06T 1/00 
H04N 5/76 



(21 Application number : 10-184073 
(22)Date of filing : 30.06.1 998 



(71 Applicant : OMRON CORP 

(72)Inventor : YOSHIKAWA TETSUO 
MAEDA TAD ASM, 
TABATA HISAHIRO 
KOZURU TOSHIYUKI 



(54) PERSON IMAGE PROCESSOR 

(57)Abstract: 

PROBLEM TO BE SOLVED: To add decoration with the decoration prevented from 
overlapping on a body part area such as a face and a head by providing a means which 
sets the position and area of the body part area and a means which selects a 
background area and adds decoration. 

SOLUTION: Plural kinds of reference templates are preliminarily prepared and pattern 
matching js carried out while scanning on a personal image that is an original image. 
And, the range of a facial part area 23 is set. Further, an elliptical facial area 24 having 
a fixed size is assumed based on the position and range of the area 23 and the 
background area 25 of the personal image except the area 24 assumed in accordance 
with the area 23 is specified as an area that can be decorated. And, decoration that is 
preliminarily selected in the step of synthetic frame selection, e.g. a single pattern 26 is 
arranged at every random position while changing its size and is added to the specified area 25. In 
the pattern 26 is controlled not to be arranged at the area 24 corresponding to .the. area: 23.. 
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* NOTICES * 

JPO and NCIPI are not responsible for any 
damages caused by the use of this translation. 

1. This document has been translated by computer. So the translation may not reflect the original 
precisely. 

2. **** shows the word which can not be translated. 
3.1n the drawings, any words are not translated. 



CLAIMS 



[Claim(s)] 

[Claim 1] Portrait image-processing equipment characterized by having a means to set up the location 
and range of body subregion based on at least one element which constitutes the body part of a portrait 
image, and a means to choose the background region except body subregion and to add an ornament 
[Claim 2] Portrait image-processing equipment characterized by having a means to set up the location 
and range of body subregion based on at least one element which constitutes the body part of a portrait 
image, and a means to choose the background region except body subregion and to perform image 
transformation processing. 

[Claim 3] Portrait image-processing equipment characterized by having a means to set up the location 
and range of body subregion based on at least one element which constitutes the body part of a portrait 
image, and a means to add an ornament along the periphery enclosure of body subregion. 
[Claim 4] Portrait image-processing equipment characterized by having a means to set up the location 
and range of body subregion based on the beige part of a portrait image, and a means to choose the 
background region except body subregion and to add an ornament. 

[Claim 5] Portrait image-processing equipment characterized by having a means to set up the location 
and range of body subregion based on the beige part of a portrait image, and a means to choose the 
background region except body subregion and to perform image transformation processing. 
[Claim 6] Portrait image-processing equipment characterized by having a means to set up the location 
and range of body subregion based on the beige part of a portrait image, and a means to add an 
ornament along the periphery enclosure of body subregion. 

[Claim 7] It is portrait image-processing equipment which it is portrait image-processing equipment 
indicated to either claim 1 thru/or claim 6, and a body part is a face part, and is characterized by body 
subregion being face subregion. 

[Claim 8] It is portrait image-processing equipment which it is portrait image-processing equipment 
indicated to either claim 1 thru/or claim 6, and a body part is a part for a head, and is characterized by 
body subregion being a head part field. 
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DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Field of the Invention] This invention starts portrait image-processing equipment, and relates to the 
portrait image-processing equipment used including in the play device which prints and outputs portrait 
images, such as a user s face and the whole body, to various kinds of print media especially. 
[0002] 

[Description of the Prior Art] It compounds, after laying portrait images which it finished photoing, such 
as a users face and the whole body, with ornament frames, such as a pattern and a pattern, on top of 
the inside of this kind of play device. And there is a seal automatic vending machine considered as the 
configuration printed and outputted to the print media called seal, and in recent years, the play device 
which can add a pattern like scribble on a synthetic image is also developed, using input means, such as 
a tablet. Or when the blue sheet (curtain) has been beforehand arranged to a users tooth-back side 
again, a photograph is taken, and there are some which were considered as the configuration which 
chooses a sheet and a corresponding background region and adds the ornament of a pattern, a pattern, 
etc. 
[0003] 

[Problem(s) to be Solved by the Invention] By the way, in said conventional play device, in spite of 
having adjusted so that a portrait image might be settled in an ornament frame, in order for ornaments 
to overlap and for the amount of [ the face part of a portrait image, ] head etc. to hide, un-arranging 
[ that it can be hard to obtain a portrait image with a clear face part etc. ] has arisen. In addition, same 
un-arranging is to produce what scribble wrote and was considered as the configuration in which **** is 
possible. In the thing of a configuration of, choosing a blue sheet and a corresponding background region 
on the other hand, and adding an ornament, since the range which can add an ornament will be 
restricted inevitably, use which adds an ornament also to a face part effective in detection of a person 
or the body part except a part for a head, and raises play nature was not completed. 
[0004] After making it these things [ that an ornament laps with the body part of a portrait image and 
the body subregion especially set up corresponding to the face and head ] not exist, it is possible to add 
an ornament, an example is taken inconvenient, it is originated and this, invention aims at offer of the 
portrait image-processing equipment which can aim at use expansion of a play device after raising play 
nature more. 
[0005] 

[Means for Solving the Problem] Here, after giving explanation of the vocabulary indicated to the claim, 
and explanation of technical thought, The means for solving a technical problem is explained. 
[0006] A "portrait image" is an image with which a person s part or all images are contained. Therefore, 
the whole persons image is sufficient and you may be the image of only a person's face and the sight of 
your back, or the upper half of the body. Moreover, the image with which two or more persons are 
reflected is sufficient. Of course, what kind of patterns, such as scenery other than a person and a 

pattern* may be in a background. - - . . .. ~, - 

[0007] It will be called a body part, if it is the semantics of a part of a person's body, and the "body 
part" is a part which it can recognize that it is a part of human beings body even if it has equipped the 
body part with dress, a hat, or shoes and its skin cannot be seen. Therefore, a face is a body part and 
the head is also a body part. Furthermore, an eye, a nose, opening, a lug, eyebrows, hair, a neck, the 
upper half of the body that wore dress, a hand, an arm, a guide peg, the guide peg that wore shoes, the 
head which was wearing the hat, the eye which hung glasses are body parts. 

[0008] "Body subregion" may be a field set up noting that a body part is the field occupied on an image, 
and even if body subregion contains except the body part in the interior, it may be a field set up inside a 
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body part. That is, supposing a body part is a face, a little field in the perimeter of a face may be 
included, and the body subregion corresponding to a face is the rectangle of the minimum size 
surrounding both eyes, opening, and a nose, and may contain neither a frame nor a lug. 
[0009] An "ornament" may be an image pattern added, and this image pattern may be an image pattern 
currently held beforehand, and may be an image pattern generated with a computer graphic technique. 
Moreover, this image pattern may be an alphabetic character, the pattern of a notation, and a pattern of 
a graphic form. 

[0010] All processings that "image transformation processing" considers an image as an input like 
concentration conversion of an image, or filtering and affine transformation, and output an image are 
said. 

[0011] Hereafter, The means for solving a technical problem is explained succeedingly. 
[0012] The portrait image-processing equipment concerning claim 1 of this invention is characterized by 
having a means to set up the location and range of body subregion based on at least one element which 
constitutes the body part of a portrait image, and a means to choose the background region except 
body subregion and to add an ornament. And since an ornament is not added within the limits of the 
body subregion set up based on the element which constitutes a body part according to this 
configuration, it will be lost that a body part overlaps an ornament and it will not happen that a body part 
hides by the ornament. 

[0013] The portrait image-processing equipment concerning claim 2 of this invention was equipped with 
a means to set up the location and range of body subregion based on at least one element which 
constitutes the body part of a portrait image, and a means to choose the background region except 
body subregion and to perform image transformation processing, and was constituted. Since according 
to this configuration the background region except the range of body subregion is chosen and image 
transformation processing can be performed, it becomes possible by gradating the color of a background 
region or making it change to make a body part conspicuous. 

[0014] The portrait image-processing equipment concerning claim 3 of this invention is characterized by 
having a means to set up the location and range of body subregion based on at least one element which 
constitutes the body part of a portrait image, and a means to add an ornament along the periphery 
enclosure of body subregion. Since an ornament is added along the periphery enclosure of the set-up 
body subregion according to this configuration, while emphasizing especially a body part and making it 
conspicuous, the advantage of : becoming p^ossibje to raise play nature is. .secured. ^ . - 
[0015] The portrait image-processing equipment concerning claim 4 of this invention A means to set up 
the location and range of body subregion based on the beige part of a portrait image, While it has a 
means to choose the background region except body subregion and to add an ornament, the portrait 
image-processing equipment concerning claim 5 It has a means to set up the location and range of body 
subregion based on the beige part of a portrait image, and a means to choose the background region 
except body subregion and to perform image transformation processing. Moreover, the portrait image- 
processing equipment concerning claim 6 is equipped with a means to set up the location and range of 
body subregion based on the beige part of a portrait image, and a means to add an ornament along the 
periphery enclosure of body subregion. Therefore, according to these configurations, the same 
advantage as each of claim 1 thru/or claim 3 will be secured. 

[0016] The portrait image-processing equipment concerning claim 7 of this invention is indicated to 
either claim 1 thru/or claim 6, a body part is a face part, and it is characterized by body subregion being 
face subregion. Since it becomes possible to add the ornament same also about the body part except a 
face part effective in detecting a person as a background region, to perform image transformation 
processing, or to add an ornament along the periphery enclosure of face subregion when this 
configuration is adopted, play nature can be raised more. 

[0017] Like the portrait image-processing equipment which the portrait image-processing equipment 
concerning claim 8 of this invention also requires for claim 7, it indicates to either claim 1 thru/or claim 
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6, and a body part is a part for a head in this claim 8, and body subregion is a head part field. Therefore, 
according to this configuration, the advantage that it becomes possible to prevent that the head part 
field included in body subregion overlaps an ornament, and to make the amount of head conspicuous is 
secured. 
[0018] 

[Embodiment of the Invention] Although the portrait image-processing equipment concerning this 
invention is explained hereafter, first, the whole seal automatic-vending^machine configuration and 
actuation for which it is used by this portrait image-processing equipment, incorporating and which are a 
play device are explained. That is, it is the explanatory view which drawing 1 simplifies the hardware 
configuration of a seal automatic vending machine, and is illustrated, and the block diagram which 
drawing 2 simplifies the functional module configuration, and is illustrated, and drawing 3 is a flow chart 
which illustrates the fundamental game processing sequence. 

[0019] It has a video camera 1, a personal computer 2, the seal printer 3, the coin device 4, CRT5, and a 
half mirror 6, and the seal automatic vending machine which is a play device is constituted so that it 
may illustrate by drawing 1 and drawing 2 , and these each is arranged after positioning inside the body 9 
of a device possessing a control panel 7 and an electric power switch 8. And the video camera 1 here 
photos a users image, a portrait image is transmitted to a personal computer 2, a personal computer 2 
operates as a control means which realizes various kinds of functions, and the seal printer 3 is printing 
the synthetic image transmitted from the personal computer 2 to seal paper. 

[0020] That is, as a function which a personal computer 2 realizes, there are recognition of the panel 
actuation which detection of the injection number of sheets of coin, the sequence control of a game, 
and a user perform, and switch actuation, lighting of lighting fitting and putting-out-lights control, 
acquisition of a camera image, image composition, an image output to a seal printer, etc. And Maine 
control-section 2a which constitutes this personal computer 2 controls acceptance of coin, and 
advance of a game. The coin device in which I/O board control-section 2b is an external instrument, and 
a control panel, While the signal I/O between lighting fitting is controlled and image control-section 2c is 
controlling acquisition directions of an image, composition of a set photograph, the display of a synthetic 
image, and maintenance of a synthetic pattern 2d of video .camera control sections controls the field 
angle of a video camera, exposure, and automatic setting of a focus, and video capture control-section 
2e is controlling acquisition of an image. 

[0021] Moreover, the coin device 4 is what detects an injection of coin and transmits a coin injection 
signal to a personal computer 2. The video signal with which CRTS has been outputted from the , 
personal computer 2, For example, it is what carries out a screen display of the video signal of the 
actuation guidance corresponding to advance of a game, a camera image, etc. A half mirror 6 makes 
even a video camera 1 penetrate a user s image, and it reflects the screen of CRTS, a user is made to 
check it by looking, and a control panel 7 transmits a switch signal to a personal computer 2, after 
receiving switch actuation of a user. In addition, each of the signs 10 and 1 1 in drawing 1 is the 
fluorescent lamp and halogen lamp as lighting fitting, while the light is switched on at the time of 
photography that these should acquire a users image in the better condition, the sign 12 in drawing 1 is 
a sheet for outdoor daylight cutoff (curtain), and this sheet 12 for outdoor daylight cutoff is arranged 

beforehand at a user's tooth-back side... 

[0022] Next, it is premised on the play mode chosen by the user here being photograph mode, and being 
in image composition mode which moreover compounds the portrait image photoed by the user and an 
ornament although the operations sequence at the time of the play mode of a seal automatic vending 
machine is explained briefly, referring to the flow chart shown by drawing 3 . In addition, the play mode 
which a seal automatic vending machine has is various, and it is not limited only to photograph mode and, 
of course, there are the modes other than image composition mode, for example, the mode of only a 
photograph etc., also in the inside in photograph mode. 

[0023] First, at the step of the waiting for a coin input, if it is continuing waiting for an injection of coin 
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and coin is thrown in by the user, displaying a demonstration image on the screen of CRTS after an 
electric power switch 8 is turned on, after checking that the coin of predetermined number of sheets 
had been thrown in, displaying supplied coin number of sheets, a game will be started. And when a game 
is started, on the screen of CRTS, the sample of an ornament frame including the ornament of the 
ornament frame which should be combined with a portrait image, i.e., a pattern, a pattern, etc. will be 
displayed covering two or more kinds, and after operating the tablet prepared in the control panel 7, at 
the step of synthetic frame selection, a user will choose the ornament frame of arbitration. 
[0024] Then, at the step of a selection result check, an ornament frame [ finishing / selection ] will be 
expanded and displayed on the screen of CRT5, and it is checked whether a user rechooses an 
ornament frame. Then, a user will direct whether reselect an ornament frame, after using the tablet of a 
control panel 7 etc., and when reselecting an ornament frame, while the sample of an ornament frame is 
displayed again, when not reselecting an ornament frame, he progresses to the step of photographic 
subject photography. And although a photograph will be taken at the step of photographic subject 
photography after the portrait image of the user who made the sheet 12 for outdoor daylight cutoff the 
tooth-back side compounds with an ornament frame [ finishing / selection ], the ornament frame in this 
case is the frame to which the ornament of a pattern, a pattern, etc. is not added. 

[0025] Furthermore, adding to the portrait image which had the ornament which the user chose photoed 
at the step of an image processing will be performed with a personal computer 2. In this case, if it is, 
processing in which set up the location and range of body subregion based on at least one element 
which constitutes the body part of a portrait image, and choose the background region except body 
subregion, and an ornament is added, and processing which is mentioned later in detail are performed. In 
addition, in the above-mentioned explanation, the ornament of a pattern, a pattern, etc. is to be chosen 
in connection with the sample of an ornament frame being chosen at the step of synthetic frame 
selection, and it is also possible to newly choose a different ornament from an ornament of finishing 
[ selection / be / it / at the step of this image processing ], and to add it so that it may mention later. 
[0026] Then, at the step of a photography result check, the synthetic image which added the ornament 
to the portrait image and was obtained will be displayed on the screen of CRTS, and or or the directions 
of whether to re-take a photograph printed by the user who checked the photography result is 
performed. And if printing is directed, printing a synthetic image to seal paper as it is also with the seal 
printer 3 will be performed, and the advance degree of printing in this case is to display that a bar graph 
is also on the screen of CRT5 in the step of printing. Then, after returning to the step of the waiting for 
a coin input, continuing. waiting for an injection of coin is performed, displaying a demonstration image. 
[0027] By the way, the personal computer 2 with which the seal automatic vending machine is equipped 
will function also as portrait image-processing equipment, and this personal computer 2 has the 
functional configuration equipped with various kinds of means which are explained below, referring to , 
each of drawing 4 thru/or drawing 10 . That is, it is the explanatory view which illustrates the procedure 
at the time of the explanatory view which illustrates the 1st procedure at the time of drawing 4 setting 
up face subregion, and drawing 5 choosing the background region except the set-up face field, and 
adding an ornament, and the explanatory view and drawing 7 which illustrate the 2nd procedure at the 
time of drawing 6 setting up face subregion are an explanatory view which illustrates the modification 
procedure at the time of choosing the background region except a face field and adding an ornament. 
Moreover, the explanatory view and drawing 9 which illustrate the procedure at the time of drawing 8 
setting up a head part field and body subregion are an explanatory view which illustrates the 2nd 
procedure at the time of setting up body subregion, and drawing 10 is an explanatory view which 
illustrates the procedure at the time of setting up a beige field. 

[0028] (The 1st configuration) The personal computer 2 first considered as the 1st configuration which 
functions as portrait image-processing equipment The eye which is the element which constitutes the 
body part of a portrait image, for example, the face part which was most suitable for detecting a person, 
a nose, eyebrows, opening, a lug, a jaw, Or it has a means to set up the location and range of face 
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subregion based on the profile of the at least one whole element chosen from from among the profiles of 
the whole face etc., for example, a face, and a means to choose the background region except the set- 
up face subregion, and to add an ornament. And the ornament is to choose the background region 
except face subregion and to be added [ in this case ], after the location and range of face subregion 
are set up by template matching using the criteria template corresponding to the profile of the whole 
face. 

[0029] That is, pattern matching while scanning the portrait image 22 top which is a subject copy as 
various kinds of criteria templates 21 are also is performed so that it may illustrate by drawing 4 (b), 
after preparing beforehand two or more sorts of criteria templates (concentration template) 21 from 
which a scale which is illustrated by drawing 4 (a) differs, if it was in template matching in this case. And 
as Similarity R will be evaluated after using the following normalization cross-correlation type (several 1), 
and illustrated by drawing 4 (c), after Similarity R sets up a high location as a location of the face 
subregion 23, setting up the range of the face subregion 23 is performed here. 

[0030] In addition, when two or more faces exist in the image in this case. Similarity R sets up a high 
location as the 2nd person's face subregion 23 in the field except the 1st person's already detected face 
subregion 23. Furthermore, while Similarity R sets up a high location as face subregion 23 in the field 
except the already detected face subregion 23 the same also about the face after the 3rd person, two 
or more persons' face subregion 23 will be hereafter set up by detecting repeatedly until Similarity R 
becomes small rather than a suitable threshold. 
[0031] 
[Equation 1] 
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[0032] Furthermore, when it does in this way and the location and range of the face subregion 23 are 
set up, it is specified as range which can ornament the background region 25 of the portrait image 22 
except the ellipse field 24 which the ellipse field 24 which has fixed magnitude after being based on the 
location and range of the face subregion 23 so that it may illustrate by drawing 5 (a) will be assumed, 
and was assumed corresponding to the face subregion 23. And the pinpointed background region 25 is 
received. The ornament beforehand chosen at the step of synthetic frame selection so that it might 
illustrate by drawing 5 (b), For example, while the single patterns 26, such as a bubble, change magnitude, 
it will be arranged and added for every random location, and controlling so that a pattern 26 is not 
arranged in the face subregion 23 and the corresponding ellipse field 24 in this case is performed. 
[0033] In addition, since an image like the so-called kaleidoscope pattern will be obtained when it is also 
possible to arrange as a pattern 26 to which the arrangement include angle was changed and it is done 
in this way after expanding or reducing face subregion 23 itself which is not necessarily limited to an 
ornament of finishing [ selection ], for example, was set up by template matching although an ornament 
of finishing [ here / selection ] is added, interest will increase further. And the pattern 26 which is an 
ornament does not overlap at all the face subregion 23 of the synthetic image 27 22 which is illustrated 
by drawing 5 (c), i.e., a portrait image, as a result to which the above image processings were carried out, 
but the synthetic image 27 which comes to add an ornament only to the background region 25 of the 
portrait image 22 is obtained. That is, in the personal computer 2 considered as this 1st configuration, 
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setting up the location and range of the face subregion 23 is performed, and since the ornament same 
also into the body part except the face subregion 23 effective in detecting a person as a background 
region 25 is added, play nature is to increase more. 

[0034] (The 2nd configuration) Next, referring to drawing 6 , an element which constitutes a face part is 
an eye and the functional configuration of a personal computer 2 considered as the 2nd configuration 
which sets up the location and range of face subregion by template matching based on an eye is 
explained. That is, pattern matching while scanning the portrait image 22 top which is a subject copy as 
the criteria template 28 is also is performed so that it may expand and illustrate by drawing 6 (b), after 
preparing two or more sorts of criteria templates 28 corresponding to an eye so that it may illustrate by 
drawing 6 (a) in this case. And if the locations L and R of the eye in the portrait image 22 are detected 
so that it may illustrate by drawing 6 (c) the fixed Ruhr (several 2) on the basis of the locations L and R 
of the detected eye — that is, By performing count according to the following Ruhr which has defined 
the interrelation of the location of an eye, and the field of a face, finding out a reference point P, and 
assuming the field of predetermined height h and the predetermined width of face w based on the 
location of this reference point P A location and range of the face subregion 23 which are expanded and 
illustrated by drawing 6 (d) are set up. 
[0035] 
[Equation 2] 
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[0036] In addition, although the face subregion 23 is to be set up after being based on both eyes in 
drawing 6 , there may not be necessity which is both eyes, for example, you may be one eye, and after 
being based on elements other than eyes, such as a nose and a lug, of course, the location and range of 
the face subregion 23 may be set up. Furthermore, succeedingly, if the location and range of the face 
subregion 23 are set up After following the same procedure as it illustrated by drawing 5 (a) and (b) and 
the 1st configuration explained, an ornament will be added to the background region 25 except the face 
subregion 23 (ellipse field 24), and the same synthetic image 27 is obtained with having illustrated by 
drawing 5 (c) as the result. 

[0037] By the way, although it is to be arranged for every random location by the technique of the 
ornament addition illustrated by drawing 5 while the single patterns 26, such as a bubble, change 
magnitude So that it may not be restricted to such technique and may illustrate in the modification of 
drawing 7 the technique piled up with the portrait image 22 after preparing ornament frame 29 with the 
another portrait image 22 with which the location and range of the face subregion 23 were set up and 
making correspondence field 23a with the face subregion 23 in this ornament frame 29 into a null — or, 
although the illustration abbreviation is carried out The technique piled up after changing the 
transparency in the face subregion 23 in a background region 25 is employable. And of course [ also 
when such technique is adopted ], the same synthetic image 27 is obtained as drawing 5 (c) showed. 
[0038] (The 3rd configuration) Although the personal computer 2 considered as the 3rd configuration is 
explained succeedingly, referring to drawing 8 The hair and the beard which are the element which 
constitutes a part for the head to which this personal computer 2 fitted detection of a person following 
the body part, i.e., face part, of a portrait image, Or it is the thing equipped with one element chosen 
from from among the same eye as a face part, the nose, etc. again, for example, a means to set up the 
location and range of a head part field based on the top-most vertices of the hair, and a means to 
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choose the background region except the set-up head part field, and to add an ornament 
[0039] And with this 3rd configuration, the ornament is to choose the background region except a head 
part field, and to be added by adopting the same technique with having described above, after chroma- 
key processing detected the top-most vertices of the hair, and being based on these top-most vertices 
and setting up the location and range of a head part field. In addition, chroma-key processing here 
means the processing which presumes the location and range of a head part field etc. which are a body 
from the property in the location and range of a field which were extracted after extracting the field 
which the body which has interrupted the before [ the background specified ] side occupies. 
[0040] Namely, chroma-key processing of the portrait image 22 which is the subject copy which is 
illustrated by drawing 8 (a) in this case is performed. After producing the chroma-key image 31 31 which 
is illustrated by drawing 8 (b), i.e., the chroma-key image with which only the body part 32 which is the 
upper half of the body of the portrait image 22 was extracted, so that it may illustrate by drawing 8 (c) 
The top-most vertices P of the extracted body part 32 are detected, and setting up the location and 
range of the head part field 33 by assuming the field of the predetermined height on the basis of the 
location of these top-most vertices P and predetermined width of face is performed. In addition, on the 
occasion of judgment evaluation of whether an assumption field is the head part field 33, the technique 
judged from a perimeter ratio and surface ratio after [ some technique of being already well-known, for 
example, an assumption field, ] being the combination of a circumscription rectangle and a hall^ellipse, 
the technique of setting up a head part field, after making the field below a fixed concentration value 
into a hair field, etc. are adopted. 

[0041] And if the location and range of the head part field 33 are set up as it is also by such procedure 
After following the same procedure as it illustrated by drawing 5 (a) and (b) and the 1st configuration 
explained, an ornament will be added to the background region 25 except the head part field 33 (ellipse 
field 24), and the same synthetic image 27 is obtained with having illustrated by drawing 5 (c) as the 
result. In addition, although the head part field 33 is set up here after being based on the top-most 
vertices of the hair, there is no necessity on the basis of the top-most vertices of the hair, for example, 
not the hair but a beard and an eye, a nose, eyebrows, opening, a lug, the jaw of the folding point of the 
head, a neck and a neck, and a shoulder being criteria, etc. are natural again. In addition, since the same 
ornament as a background region 25 is added even to the body part except a part for a head effective in 
detecting a person also with the personal computer 2 considered as this 3rd configuration, play nature is 
increasing more. ........ 

[0042] Although setting up the location and range of a head part field based-on one element which the 
body piart of a portrait image is a part for a head, and constitutes a part for this head from (the 4th 
configuration) and time with the personal computer 2 considered as the 3rd configuration is performed, 
it is also possible to set up body subregion based on the body part of a portrait image itself. So, the 4th 
configuration explains the case where a personal computer 2 is what sets up body subregion based on 
the body part of a portrait image, for example, the upper half of the body. 

[0043] That is, chroma-key processing as well as the 3rd configuration having explained on this occasion 
is performed to the portrait image 22 which is the subject copy which is illustrated by drawing 8 (a), and 
producing the chroma-key image 31 31 which is illustrated by drawing 8 (b), i.e., the chroma-key image 
with which only the body part 32 of the portrait image 22 was extracted, is performed. Then, although it 
is carrying out the illustration abbreviation after setting up the body subregion 34 by considering as it is 
that the body part 32 which is the extracted upper half of the body is the body subregion 34 is 
performed The synthetic image with which an ornament will be added to the background region except 
this body subregion 34, consequently the background region except the body subregion 34 of the 
portrait image 22 was chosen, and the ornament was added is obtained. 

[0044] in addition, time amount change which it is not limited to chroma-key processing, for example, is 
illustrated by drawing 9 although it is performing adopting chroma-key processing and extracting the 
body part 32 with this 4th configuration — it is also possible to set up the body subregion 34, after 
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using the dynamic body field detection technique by difference. Namely, body partial 32b after body 
partial 32a before predetermined time passes, and predetermined time pass in this technique is detected, 
respectively (refer to drawing 9 R> 9 (a)), difference before and after predetermined time passes — this 
difference after computing field 32c (refer to drawing 9 (b)) — making into the body subregion 34 the 
range surrounded by field 32c is performed. And even if it uses the dynamic body field detection 
technique, it is checked by the artificers of this invention that the same result as chroma-key 
processing can be secured. 

[0045] (The 5th configuration) In the 1st thru/or the 4th configuration explained above, although setting 

up the location and range of body subregion based on at least one element which constitutes the body 

part of a portrait image is performed, further again It is also possible to use the personal computer 2 

considered as the 5th configuration which it is not restricted to these configurations and explained 

below as portrait image-processing equipment. That is, this personal computer 2 is equipped with a 

means to set up the location and range of body subregion based on the beige part of a portrait image, 

and a means to choose the background region except body subregion and to add an ornament. 

[0046] In the personal computer 2 considered as this 5th configuration The RGB chroma-key processing 

to the portrait image 22 which is the subject copy which is illustrated by drawing 10 (a), That is, after 

carrying out RGB chroma-key processing in which the field of the color component which suits the 

following conditions (several 3) is set up as a beige field, The chroma-key image 35 35 which consists 

only of a beige field which is illustrated by drawing 10 (b), i.e., the chroma-key image with which only the 

beige part 36 of the portrait image 22 was extracted, is produced. Then, after following the same 

procedure as it illustrated by drawing 5 (a) and (b) after setting up the extracted beige part 36 with the 

face subregion 23, and the 1st configuration explained, an ornament will be added to the background 

region 25 except the face subregion 23, and the same synthetic image 27 is obtained with having 

illustrated by drawing 5 (c) as the result. 

[0047] 

[Equation 3] 
RsxCri<Rt<RsxCri 

GsxCgi <Gt< GsxC 8 2 

BsxCbi<Bt< BsxCbi 

[0048] By the way, in the gestalt of this operation, although an ornament is added to the background 
region 25 except the face subregion 23, the head part field 33, and the body subregion 34, it is possible 
by performing image transformation processing only to this background region 25 rather than adding [ for 
example, ] an ornament to gradate the color of a background region 25 or to also make it change. 
Moreover, it is also possible to add an ornament which does not add an ornament to the background 
region 25 except the face subregion 23 etc., or does not perform image transformation processing, and 
is called aura along periphery enclosures, such as the face subregion 23. 
[0049] And since the face subregion 23 in the portrait image 22 etc. will be conspicuous and 
conspicuous from a background region 25 when it does in this way, the advantage that the play nature in 
a play device increases further is secured. In addition, although [ the above explanation ] used building 
the personal computer 2 which functions as portrait image-processing equipment into the seal 
automatic vending machine which is a play device, of course, you may be what the inclusion place of 
portrait image-processing equipment is not restricted only to a play device, and is used, being included 
in the devices and equipment other than a play device. 
[0050] 
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[Effect of the Invention] A means to set up the location and range of body subregion based on at least 
one element or beige part which constitutes the body part of a portrait image according to the portrait 
image-processing equipment concerning this invention, Since an ornament is not added within the limits 
of the body subregion set up based on the element or beige part which is equipped with a means to 
choose the background region except body subregion and to add an ornament, and constitutes the body 
part of a portrait image It will be lost that a body part overlaps an ornament and it will not happen that a 
body part hides by the ornament. Since it becomes possible to add an ornament after making it an 
ornament not lap about a part for the face part or a head especially, the effectiveness that play nature 
can be raised further is acquired obtaining a portrait image with a clear face part etc. 
[0051] Moreover, since the background region except the range of body subregion is chosen and image 
transformation processing can be performed when it has a means to choose the background region 
except body subregion and to perform image transformation processing, it becomes possible by 
gradating the color of a background region or making it change to make a body part conspicuous. Since 
an ornament is added along the periphery enclosure of the set-up body subregion when it has a means 
to add an ornament along the periphery enclosure of body subregion further again, while emphasizing 
especially a body part and making it conspicuous, the effectiveness that play nature can be raised and 
use expansion of a play device can be aimed at is also acquired. 



[Translation done.] 



* NOTICES * 

JPO and NCIPI are not responsible for any 
damages caused by the use of this translation. 

LThis document has been translated by computer. So the translation may not reflect the original 
precisely. 

2.**** shows the word which can not be translated. 
3.1n the drawings, any words are not translated. 



DESCRIPTION OF DRAWINGS 



[Brief Description of the Drawings] 

[Drawing 1] It is the explanatory view which simplifies and illustrates the hardware configuration of a 
seal automatic vending machine. 

[Drawing 2] It is the block diagram which simplifies and illustrates the functional module configuration. 
[Drawing 3] It is the flow chart which illustrates the fundamental game processing sequence. 
[Drawing 4] It is the explanatory view which illustrates the 1st procedure at the time of setting up face 
subregion. 

[Drawing 5] It is the explanatory view which illustrates the procedure at the time of choosing the 
background region except a face field and adding an ornament. 

[Drawing 6] It is the explanatory view which illustrates the 2nd procedure at the time of setting up face 
subregion. 

[Drawing 7] It is the explanatory view which illustrates the modification procedure at the time of 
choosing the background region except a face field and adding an ornament. 

[Drawing 8] It is the explanatory view which illustrates the procedure at the time of setting up a head 
part field and body subregion. 

[Drawing 9] It is the explanatory view which illustrates the 2nd procedure at the time of setting up body 
subregion. 
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[Drawing 10] It is the explanatory view which illustrates the procedure at the time of setting up a beige 
field. 

[Description of Notations] 

2 Personal Computer (Portrait Image-Processing Equipment) 
23 Face Subregion 
25 Background Region 

33 Head Part Field 

34 Body Subregion 



[Translation done.] 
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Lfc-SO/w^ (&2) % 0*9 v S©ttB£S©ffi 

Kit?, 136 (d) ^*LT«5H-3J:5>ie«WWHH 
i£2 3tWnRxmB#W0£iSti&. 

[0 0 3 5] 

(ft2) 

&0>t<g : w - C„ x (xr - */) 

f&0>l&i£:h = Qxw 

ffi&igfl) &±X&A : jc/» - xl -Dmxw 

mfaW<D£.±Y&te:yp-yl-Dyxh 

[0 0 3 6] /«Cib\ EI6-mMBicgoW;:5 ^i-e^^FP 
#ffi&2 3#KJfc£av5;i ilCftoTV»5i«, PogT'fc 

fc 5 2 3 ©i£fi,RtmBSrIS:J£ LTfc £ 

3 ^)ffiKRt«6H*5K3fe $ *b.S £ . El 5 . ( a ) , ..< b L . 

ICt£ofc5xT«lH5#ffii|£2 3 (ttn«tt2 4) 

2 5 L.-C*«i!»f*JP £ £ fcfc •> , -t 
©$£*£ LTEI5 (c) "C0iJ*:Lfci:lRl«CD^i®^2 
7;&S#fc*L5. 

[0 0 3 7] £ £ 5T% El 5 X*M^ LfcttiMHillO^itc 
•CI1, v^stfVBE &£■©«): 5^*— <D^ffi2 6*5^#$ 
Srat-fk**** 7 vyA^ttBfefciag$tu5 w £ Ic 
/iot^5«s v ;:©<£ 5 &#ft»-PSb;}x3 -£«:&</ *>© 
El 7 ©*»H-eH5*T* J; 5 0A^1H«2' 
3 ©teKAiraH#lit£3*tfcA*«tt2 2 £ »igiJ©3S 

— A 2 9 Affile U J^O, ^©^fp7U— A 2 9 
K*5tf3glg(!#iSi&2 3 £©*mr^i&2 3 a ££6£ L 
fc5*T-A<g5»&2 2 £fiia-g-i5*5#&, fcSvMi, 
0*«l*L-CV*aas, ®gB#S«$2 3K*5tt5jgl3j|&£ 
Wft1Dt# 2 5 £ feitfc 5 ^-efiia-g-^-yr-S^^ 
£*tfiJfflW«§-Cfc5c *LT, w©«tp/«c#feSr^fflL 
fcKSKfc, 1215 (c) ^Lfc©£|l^©-£j*ilrt&2 7 

[0 0 3 8] EI8 3r#J!BLft 

tffc. ^3©fl?^£$^fc^-y^3^f^.-^2Sr 



/0 

&©#&&#, o^t), mm#i,z.m s xAV>)(Dtkm\zm 
Ltcm&ft&m&i-zmmxhz £ ^©sift-^sist, 

&£*vrt:-o©gilf N SB*OIBjfeK:*-5^Ta 

#®£*{t^fct©£/io-C^5. 
[00 3 9] -t It, :i ©31 3 ©#?/&-?(*, ^D-vdr- 

±!E Lfc £ l^#©#i*SrS?ffl1-5 r £ J; o TSIA^HI 

[0 0 4 0] ^©Hfcjfevvttt, El 8 (a) 

toaSrHtTL, El 8 (b) XW7rrr2>£5t£?v^*~ 
M3K o*!3, Afe®^2 2©_h^#Tfo5#^ 
#3 2<D%-&mm£*l1Z* a-?*-m&3 1 Lfc 
El 8 (c) -efiaj/T%-t-5J:5^, ttm^tufc*^^ 
3 2©Bl&P£r£ltHU ^©II/SP©te«SrSip£ Lfc 

3 3©teBSU 5 $5HSr^-t-S^£^^ff$^5o 
l-^.L.TH>..gE^*0£.^o.Tl\5^O^©#.&, 

-fe<DfemmuT<omm&mmm&k Lit 5 ^xngB^ 

€B«SrK3£-t-5¥ffi*£** s «ffl$^S. 

[004 1] ^LT, r©«t5^¥«M-etoTSgl5^ 
«3 3©&«&tKl£B#lS££;h,5£, El 5 (a) , 

(b) -CflSJ^U ^o, J|llO«riiTMftMLfco£W« 
©#W^t«f ofc 5 *.t?IS»»«* 3 3 (ffiR^Migc 2 4 ) 

sr» < * 2 5 tea- Lxmm&mn ztizzt\zt£ 
9s *©ig*£LTEi5 (c) xm^Littmm<o^ 

40 i«2 7*#fcJi5. ft*. ; PS©WjSStS 

©m^^s^£-r?)^tt«^^©-efc!9, n 

S-Cli/^tlS^I^ 5, S^£, fc5 

l^ttSfc. IS£l' J ?'f £M£©Sft.^^aip-efooTt> 
«tVNr£fi^t»fe5. r©^3©fl?^£$nfe 
/<-yt;^yfa-^2Tt > A^Sr^m-t-5©^^r 

»i««»*llfV^#«»»t*"<W*«*2 5 £p)« 
so [004 2] (^4©«fig) £-3T% «3©«^£$ 
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fc»tu-Cl>4*^ A*BMt©*l«MM:© , b©te£<JV''"C 
[0 0 4 3] i-4tot>. dODBHcJa^Ttt, JB3©«rit 

T?tftPJtfcWtlRlD< , E)8 (a) -QM^-f-Z X 0 *m. 
ffl-Cfc3A<t&IB&2 2l:*tLt^o-74~ 
1218 (b) T?M^i _ '5<};5^^D-7^-iij^3 1, 
!? x AfeH4fe2 2 3 2©^.^ftmStufc^ a 

*4ffl$nfc±¥#T-fc-5##gB#3 2Sr^O**# 

M^Srii:*!), A4MB4fc2 2©#* 

[0 0 4 4] zo>m4<otitf&-eii*w*—tQ& 
SrSfll LT*(H»# 3 2 r 4: SrUff LTV >5 

0«Ji(i, 111 9 -e09^i"5 «t 5 fcttHHEMfcg&K: J;5Sofl£ 

tt. WS«PM^ftiB.-t t -5W©JJ'fls»»3 2 a fc@fi©*|«J 
... . #SiB Lfc'&©.##SB# 3 2b.t Sr-t JvPJt4*jW L- (B 
9 (a) #RS) ^ Bf^^* 5 Sia-r5^(O^^Js!c3 
2c«r*fflLfc5;L (0 9 (b) &M) v 
3 2 c£J:oTH*;fcfcttHS:#fcBMHWJE3 4 £-T5 

[004 5] (^5©M) $? ) l:Sfc > WJLfe 
JBl*v*L*4©*j£fc*s«,vCtt:» A4felir<ft£>JI'tt*B£- 

^ttfiS^iiSiaSrlSJti-S^t^^tvTVNS*^ r 
;ftib<Ofl?j£K|5B'=>ix5^ fctt4l^©Tfc!K KTl:SftK 
■f 5 « 5 i: $ 1tft'<— V -Tjv =» v a - * 2 Sr A 

^H^a^st uT^-rs^t t>^iigt?$>2)o -r4 

$¥Si» #«£^^5rl^^fcWf:^Sr^L.T^v 
[0 0 4 6] w<o«5<o«lBS;i:$ : ixfc/<-y^i'3Vb- 

— ^2T?fi, El 10 (a) T?#j7j*i"2> «fc p 40Bi'T?fc- 
5AfeiB&2 2t::#LT©RGB:7 n^?*— 0$v 



(7) 

El 1 0 ( b ) "C0iJ^i-5 «£ 5 4M£,£W&W*d> b 4 
5* n-v*-iIH&3 5, o£?k A$>ili& 2 2 
#3 6©*^tttaS*t*:^B^*-lf«3 5#tf5«S*b 
-5c 3ltiBc#\ ttffl3ftfcM6tt#3 6fc«»#tI«2 
3t^SLfc5x, EI5 (a) , (b) -?0iJ^U A» 

X*mn$m&2 3*6*<1MHfltt2 5fc»LX«»4Sf* 
*P$tu?>^i:^4»5, ^(D^mtLTl2l5 (c) T?0il* 

10 ufc t mme>-&&mi& 2 7 e>ax5. . 

[0 0 4 7] 
1&3] 

Rs x Cri < Jit < Its X Cr2 
x <: Gl< x C« 2 
BsxCbi<Bt<Bs*Cbz 
fc£L 

Rs,Gs,Bs : &2gfc*££JUlfe<BRGBfiI 

20 Cast: a£SSJ[ 

[0048] *HJ£W^»C*JV^Tfi, 
jHHtt 2 3 -*>|ljB#*ltt 3 3 , gftnftm® 34?ri< 

&&&&& Srlfei" w t tiot WAWgc 2 5 ©6 Sr if 
2 3 4 i*£l&^f;:«:f:fBi!£ 2 5 icSHAiSr^Al Ufc 

y. mi&£m&m*m i^tao t&t?.. 2.34 f .. 

[0 0 4 9]vtU, r<o± 5(-Lfc^tc:ii x A'feiS^ 
2 2(C*5»t5MSB^^2 3 44r«s»JMH«2 5*»b^ 

otftpj-ett, A^rtBMwajaKUfcu-cMtM-s^-y-t- 

[0 0 5 0] 

rf. A«»if«io**»»«: i »j«i-a'><e< it-o©» 
so 4^o-e. $t&U9tl>mmtmtj-*)&b r. t»*4<4 
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ft<ft* 0 mz, zvmuft-^m&Mz^^xgim&m 

ft 3 r t ri^ft <^ <fc o K Lfc o r t & 

pile £ ft 5 *l «> . ffigB#ft i?roS&9! ft A^PHl! SrWft a* 

[00 5 1 ] #flsgI5^«c?r^v^cW*^Sr51 
(3 1"5 £, k J: o T#{*$i5^Sr^S:fc-B:S d £ # *T 

[Biao«5flB*ftSiW]- 

imi) 



14 

[12 3] ^rcoS^fty-AiaSv'— 5^>-^ SrM^-TS 
5til93l2-e$>5o 

lias] mm®z^^tziz&m%i*miRLxm®$*m\i 
■t 5 m w #jk «r ■*- s M h 0 t? h z> „ 

[I26] «ffl»«««rl8jei-5KI©J(l2©#)0l*«*i- 
[12 7] flfiHtt*ttb*fcWiHmfraKl.TSII&&ttft 

[12 9] *ff»5rti««rKSi-5»©J| 2 

[1210] IH6«*Sr»;jr*-*BStO*0Sr«gWSKW 

[fffoRWl 

2 3 m&ftm® 

20 2 5 'fffglt 

3 3 mu&wn 

3 4 JMttMHW* 

1124] 
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[&tH0] l¥7£ 2 3 P (1 9 9 9. 7. 2 
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i^mmiE 1 1 
[«g]EjEtft«ffi«] m»m 

[St#£ 1 1 Afc«»©#(MB#«r*WH-a'>* < i t 

(11*9 2 ] AaWft©#f*»#*r«j*i-*'>fc < i t> 

i-aA*B*£*UMt. 
[11*91 3 ] A*W«©#fl*#**J*i-5'>fc < 1 1) 

iX£g&£31&affiB& rmm » wfr-*- a ^a- 
fy/^- h?yfy/|zj;oTm ii ^ P tt l K »y 

r 5 1 it**M l&l: mag 3 oi^ix'a*fcia<fc 

A#nso<p»<fca<»fr«Bft^a/><e< jr^-og?g*fc 
aA«iBifcto)i»«. 
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[0015] *£|ll<oit#^4 te*v&»aA&iIite*aSg 
AttBMfc<o .»<MB<»»«Bft-*-a/j>fe<>^-o 

s„ $fc ; »*«5k:*»*»aA«»iB«teaji«tt5i*ffl 

l fev% L«3ftg 3 rov vgjl&£ iEjB Lfe ^a>-p*> Q . A 
4feMteo *tttt4>fr«ifrt-a'J>ft< ^-oog*K:3E 

■faftP-Cfea^fcfrttttfr LTV>S. 3 fete. f§*H 
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iftpji- a j: 5 ft «-aeo#a &«§ x limmmtfL *m v * 

a» -f-ft^*>v 04»i®^#ft#£t££t-aKStf>Jill© 
#HSr0iJ^i-aSiBJI2i; El 5 f*S£5£$;ftfc^iUl££:l&^ 

aitt^H-efc?), mQ\±mM&&®.*mi£-tz>&<Dn2 
©^ussrCT^-ratftB^ia, la 7 liseiigESrefe^fcit m 



t# ffl 2000 : ~22929 (P2O0O-22929A) 



(13) 



[3^*iiE6] 
[«£*)•#!§«£] WfcBS 
[*ffjE#&JSB&] 004 5 
[*§IE#*£] H'JI& 
[WftIE7] 

[*siE*t#i#su&] mtmm 
miEtt&m$%] oo4 6 

[fflJE^fe] BOB* 

[*§IE*Mil«iU&] 
[*f|jE*fSl«g£] 00 4 7 

[¥igcffliE9] 
[*fiiE*Hii««£] 
miEtt&mB%] 00 50 
[*§£#*£] £H 
[«iEl*3§] 
[0 0 5 0] 



<72)»is* /h® mm 



tf«El 0] 
[}gIE2f$§gi£] W*fBS 

[*|]EP*g] 

[01] ^-/wilbS5^a<0/^ K^iT^5r<B5BS^ 
[1212] ^<0«tg*^=--^^SrfB5BS'ftL-C^-r5 
[0 3] -toS^^^-ix^JSV-^^^.Sr^-rS 
[04 ] &m9r<gm*WtfE-1r%&<nW. l <D3Mft&0^i- 
[05] «^Srl^^fc1¥*^«§:^bTgfii^^D 

[06] mu&m}&*W!fe-r 2 (D^mzm^-r 

[0 7] KtS^^^^fc^ffl^Sr^bT^SliSr^P 

i--5^©^^«s^^-r5tftig0-efc5. 
[0 8] m&ftm®Rtfi&#&ftmm*Wife-r%&(o^ 

[0 9] #{*gp^«^l5i;)e-t-5^<D»2<o#M«^j^ 

2 3 «S6^H!c 

2 5 ig&m® 

3 3... 3B&#SWt 

3 4 #^gf5^^ 

[#>ME1 1] 

miEtt&mm*) 0ffi 

[*tIE*t#i«i£] 010 



Ff — 2H109 BA'06 BA11 

5B050 AA03 BA12 CA07 EA03 EA19 
FA02 FA03 FA09 FA12 FA13 
5C052 AA02 AA12 AB04 BB06 CC06 
DD02 EE02 EE03 FA02 FA04 
. FB01 FC02 FC06 FD03 FD09 
FD10 

5C076 AA01 AA14 AA19-BA02 CA02 



